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A multimedia decoder (10, 20) supports a plurality of functions and communicates on at least one physical communication link. The 
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Multimedia Decoder For Prioritized Bi-directional 
Communication in a Broadcast System 



10 Field of the Invention 

This invention concerns prioritized interactive bi- 
directional communication of multiple data services in a broadcast 
system. 

15 

Background of the Invention 

Home entertainment set-top box systems which 
combine Personal Computer and television functions (PC/TV 

20 functions) are increasingly becoming generic, User interactive, 
multiple source and multiple destination communication devices. 
Such systems are required to communicate in different data 
formats between multiple locations for a variety of applications in 
response to User requests. For example, a set-top box system may 

25 receive data from satellite or terrestrial sources comprising High 
Definition Television (HDTV) broadcasts, Multi-point Microwave 
Distribution System (MMDS) broadcasts and Digital Video 
Broadcasts (DVB). A set-top box system may also receive and 
transmit data via telephone (e.g. the Internet) and coaxial lines 

30 (e.g. cable TV) and from both remote and local sources such as 
Digital Video Disk (DVD), CDROM, VHS and Digital VHS (DVHS^m) 
type players, PCs, and many other types of sources. 

It is desirable for a set-top box system to be able to 
support bi-directional communication and in-home control 

35 functions and to be able to access and decode information from 
multiple broadcast sources. It is also desirable for a set-top box 
system to be able to seamlessly combine the decoded information 



Page: 3 



WO 99/18703 



PCT/US98/20702 



2 

5 for presentation to a User. There are a number of problems in 
achieving such a system. Specifically, problems arise in efficiently 
acquiring information of different data formats from different 
sources and prioritizing the processing of the information. These 
problems are addressed by a system according to; the present 
10 invention. 

Summary of the Invention 

An Internet protocol compatible multimedia decoder 
15 advantageously includes a system for prioritizing received data 
for processing by a first processor and for prioritizing data for 
encoding for return communication by a second processor. The 
received data and the return data are allocated a desired 
hierarchical data output priority based on a function associated 
20 with the data to be prioritized or a protocol characteristic of the 
data to be prioritized. 

Brief Description of the Drawings 

25 In the drawing: 

Figure 1 shows a scaleable decoder system for 
efficiently communicating with a plurality of sources and for 
processing exemplary TCP/IP and MPEG format data, according to 
the invention. 

30 

Figures 2 and 3 present exemplary characteristics of 
the broadcast, data and return channels depicted in the system of 
Figure 1, according to the invention. 

35 Figures 4 and 5 list the data traffic type and an 

exemplary bit rate allocation for services provided via the 
upstream channel and downstream channels of figure 1. 



Page: 4 



WO 99/18703 



PCT/US98/20702 



3 

5 Figure 6 shows a priority schedule system for 

prioritizing processing of broadcast and data packets for bi- 
directional applications, according to the invention. 

Figure 7 shows a flowchart of a method fof prioritizing 
10 processing of broadcast and data packets suitable for use in the 
system of Figure 6, according to the invention. 

Figure 8 shows a server distribution hub for 
distributing broadcast data from a plurality of service providers to 
15 the decoder of Figure 1 and for processing upstream data from the 
decoder of Figure 1, according to the invention. 

Figure 9 lists and describes the exemplary interfaces 
1-10 identified in the server system of Figure 8, according to the 
20 invention. 

Detailed Description of the Drawings 

Figure 1 shows a decoder system providing efficient 

25 communication with a plurality of sources, according to the 
invention. The decoder system advantageously incorporates 
separate tuner, demodulator and processing paths for concurrent 
processing and decoding of data encoded in different data formats. 
The decoder system also advantageously incorporates a separate 

30 return channel communication path permitting secure return 
communication with a broadcast source, for example. The 
exemplary embodiment of Figure 1 supports decoding of data in 
TCP/IP (Transmission Control Protocol/Internet Protocol) and 
MPEG (Motion Picture Experts Group) format (e.g. per MPEG2 

35 ISO/DEC 13818-1 of 10th June 1994, and ISO/IEC 13818-2, of 20th 
January 1995). In addition, the set-top box system of Figure 1 is 
compatible with the Multimedia Cable Networks Systems (MCNS) 
preliminary requirements. 

The architecture of Figure 1 enables scaleable (i.e. 

40 dynamically variable bit-rate) concurrent decoding of image 
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5 representative data from separate sources in different formats. As 
such, data of different data formats may be processed by the 
scaleable decoder system of Figure i without being encoded in 
accordance with an encompassing higher layer communication 
format. Thereby, the decoder system avoids the overhead and 

10 inefficiency involved in processing data hierarchically encoded 
using such an additional communication format. 

The decoder system also incorporates a scheduler 
system for prioritizing the processing of both received data and 
data for return communication to a broadcast source, for example. 

15 The received and return data is allocated a desired hierarchical 
data output priority based on features including, a) a function 
associated with the data, b) a protocol characteristic of the data, or 
c) a physical communication channel by which the data is 
conveyed. Exemplary functions performed by the decoder include 

20 i) Email, ii) Internet web page browsing, iii) Internet telephony, 
iv) conventional telephony, v) fax, vi) videophone, vii) broadcast 
video, audio and radio processing and viii) home control functions. 
The desired hierarchical data output priority is derived from a 
priority profile or map- The priority profile comprises a database 

25 allocating a relative priority to data packets associated with an 
individual function* protocol characteristic, or communication 
channel. The information in the priority profile comprises pre- 
stored default information, user entered information, or 
information broadcast to the decoder from a service provider, for 

30 example. The profile may also comprise information derived from 
several of these sources. 

Although the decoder system is described as 
processing data received via co-axial cable in MPEG and Internet 
protocol compatible format, this is exemplary only. The decoder 

35 system processes data supporting functions including Email, 
Internet web page browsing, Internet telephony, conventional 
telephony, fax, videophone, broadcast video, audio and radio and 
home control functions. Further, the principles of the invention 
may be applied to systems in which the types of transmission 

40 channels and communication protocols may vary, or to systems in 
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5 which the coding and modulation types may vary. Such systems 
may include, for example, satellite, terrestrial, Internet and intra- 
net broadcast and communication systems employing non-MPEG 
and non-Internet compatible protocols. Further, the invention 
principles apply to the processing of any form of tfata such as 

10 telephone messages, computer programs, Internet data or other 
communications, for example. 

In overview, in set- top box system 12 of Figure 1, a 
first carrier modulated with broadcast video data and a second 
carrier modulated with Internet data, e.g. web page information, is 

15 received by splitter/combiner unit 25 and processed by input 
decoder 13. Unit 13 tunes to the respective first and second 
carriers and demodulates, forward error corrects and prioritizes 
the received data to provide demodulated digital data for further 
processing by output decoder 20. Unit 13 also derives an analog 

20 video signal from the received data and provides the signal to unit 
20. Unit 20 processes the digital data including MPEG compatible 
video and audio data and Internet protocol data for display and 
audio reproduction by units 60 and 63 respectively. In another 
mode unit 20 also processes the analog video data from unit 1 3 

25 for display by device 60. 

A set-top box user selects a function to be performed, 
e.g. the viewing of a particular program or web page data, by on- 
screen menu selection and cursor command using remote control 
unit 67. Unit 15 controls the operation of the elements of input 

30 decoder 13 and output decoder 20 and responds to remote control 
unit 67 commands using a bi-directional data and control signal 
bus C Controller 15 controls the functions of individual elements 
within units 13 and 20 by setting control register values within 
these elements with control bus C In addition, unit 15, in 

35 conjunction with unit 13, initiates and prioritizes the generation 
and transmission of messages for return communication on the 
coaxial cable link to a service provider, for example. 

Considering Figure 1 in detail, splitter/combiner 2 5 
provides a frequency multiplexed signal incorporating first and 

40 second Quadrature Amplitude Modulated (QAM) carriers to tuners 
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5 30 and 65. The first and second carriers are independently QAM 
modulated using a selectable symbol constellation of either 256 or 
64 points. Tuner 30 derives a first carrier modulated with MPEG 
compatible program representative audio, video and associated 
data from the frequency multiplexed signal. Tuner 65 derives a 

10 second carrier modulated with Internet protocol web page 
representative data from the frequency multiplexed signal. Tuners 
30 and 65 include frequency demultiplexer, radio frequency (RF) 
tuner and intermediate frequency (IF) mixer and amplification 
stages for down-converting the signal from unit 25 to lower 

15 frequency bands to derive the first and second carriers 
respectively. 

Tuner 30, in conjunction with controller 15, 
determines whether the first carrier contains digital MPEG 
compatible video data or comprises an analog video signal. A 

20 digital video data representative first carrier is provided by tuner 
30 to demodulator 40 via multiplexer (mux) 35 and an analog 
video signal is provided via mux 35 to display processor 55 in 
output decoder 20. Tuner 65 provides the second carrier to 
demodulator 70. In this exemplary system, the input frequency 

25 multiplexed signal, from unit 25 contains 33 Physical Transmission 
Channels (PTCs 0-32). Each Physical Transmission Channel (PTC) is 
allocated a 6 MHz bandwidth and contains, for example, up to 6 
sub-channels each with unique carrier frequency. 

It is assumed for exemplary purposes that a set- top 

30 box user selects a sub-channel (SC) for viewing using remote 
control unit 67. Controller 15 uses the selection information 
provided from remote control unit 67 via interface 69 to 
appropriately configure elements of input decoder 13 to receive 
the PTC and corresponding carrier frequency of the selected sub- 

35 channel SC. Following down conversion, the first carrier output 
signal from tuner 30 for the selected PTC has a bandwidth of 6 
MHz and a center carrier frequency in the range of 54-806 MHz. 
In the following discussion, an RF channel or Physical 
Transmission Channel (PTC) refers to an allocated broadcaster 
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5 transmission channel band which encompasses one or more sub- 
channels. 

Controller 15 configures the radio frequency (RF) tuner 
and intermediate frequency (IF) mixer and amplification stages of 
tuner 30 to receive the selected PTC first carrier frequency. The 
10 down-converted first carrier frequency output for the selected 
PTC provided by tuner 30, via mux 35, is demodulated by unit 40. 
The primary functions of demodulator 40 are recovery and 
tracking of the carrier frequency, recovery of the transmitted data 
clock frequency, and recovery and forward error correction of the 
15 MPEG compatible video data itself. Unit 40 also recovers sampling 
and synchronization clocks that correspond to transmitter clocks 
and are used for timing the operation of tuner 30, demodulator 4 0 
and scheduler 43. 

Unit 40 demodulates the QAM modulated first carrier 
20 signal to provide demodulated digital output data. Also, in unit 40, 
the demodulated digital output data is mapped into byte length 
segments which are deinterleaved and Reed-Solomon error 
corrected according to known principles. In addition, unit 4 0 
provides a Forward Error Correction (FEC) validity or lock 
25 indication to controller 15. Reed-Solomon error correction is a 
known type of Forward Error Correction. The FEC lock indication 
signals that the Reed-Solomon error correction is synchronized to 
the data being corrected and is providing a valid output. It is to be 
noted that the tuning, demodulator and decoder functions 
30 implemented by units 30 and 40 (and also units 65 and 70) are 
individually known and generally described, for example, in the 
reference text Digital Communication, Lee and Messerschmidt 
(Kluwer Academic Press, Boston, MA, USA, 1988). The recovered 
output from unit 40 is in the form of an MPEG compatible 
35 transport datastream containing program representative 
multiplexed audio, video and data components. This transport 
stream is provided to scheduler 43. 

The second carrier, modulated with Internet protocol 
web page representative data, is derived by tuner 65 and 
40 demodulated and error corrected by unit 70. Tuner 65 and 
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5 demodulator 70 duplicate the tuner and demodulator functions of 
units 30 and 40 respectively and advantageously provides an 
independent processing path permitting concurrent processing of 
Internet protocol data and MPEG compatible data, for example. 
Tuner 65 and demodulator 70 operate in the manner previously 

10 described in connection with corresponding units 30 and 40. 
Tuner 65 and demodulator 70 provide data to scheduler 43 in 
Internet protocol format representing a user selected web page. 

Scheduler 43 in conjunction with controller 1 5 
prioritizes both the Internet protocol data from demodulator 7 0 

15 and the MPEG compatible transport stream data from demodulator 
40, for processing by elements of output decoder 20. Scheduler 4 3 
and controller 15 also prioritize the data for return communication 
via the coaxial cable link to a broadcast source, for example. 
Scheduler 43, under control of unit 15, identifies individual 

20 Internet protocol packets from unit 70 representing a specific 
function e.g. web page information requested via a web browser. 
In addition, scheduler 43, under control of unit 15, identifies 
individual MPEG compatible packets representing a specific 
program e.g. "Seinfeld™" on a selected channel NBC™ and 

25 associated data. The associated data comprises packet 
identification and assembly information supporting the MPEG 
decoding and recovery of a program and also includes ancillary 
sub-picture information for display such as program guide data. 

30 Scheduler 43 incorporates a demultiplexer for 

matching the PIDs of incoming MPEG packets in the datastream 
from unit 40 with PID values pre-loaded in control registers 
within unit 43 by controller 15. Similarly, scheduler 43 matches 
data identifiers such as data source and data destination, data 

35 type, IP address, and Universal Resource Locator (URL) codes in 
the Internet protocol datastream from unit 70 with values pre- 
loaded in control registers within unit 43 by controller 15. This 
matching process serves to identify the function and program 
representative Internet and MPEG data packets for prioritizing 

40 and further processing. The resultant identified Internet and 
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5 MPEG packets are stored in memory and sequentially accessed in 
accordance with a predetermined priority profile (map) 
associating data having a specific characteristic and function with 
a desired priority. Thereby, unit 43 provides buffered prioritized 
Internet protocol data including web page HTML™ : (Hyper Text 

10 Mark-up Language) and associated Java™ data (and other data e.g. 
JPEG, GIF, TIF type data) to HTML™ processor 75. Unit 43 also 
provides the prioritized MPEG video, audio and sub-picture 
packets to MPEG video decoder 50, audio processor 61 and sub- 
picture processor 80 respectively. The method of operation of 

15 scheduler 43 and its implementation is described later in more 
detail in connection with Figures 6 and 7. 

MPEG decoder 50 decodes and decompresses 
prioritized MPEG compatible packetized video data from unit 4 3 
and provides prioritized decompressed program representative 

20 pixel data for storage in the pixel representative memory in 
display processor and NTSC encoder 55. Audio processor 61 
decodes prioritized packetized audio data from unit 43 and 
provides prioritized decoded and amplified audio data 
synchronized with the associated decompressed video data to 

25 device 63 for audio reproduction. Processor 75 decodes the 
HTML™ and Java™ encoded web information from unit 43 and 
provides web page image representative pixel data for storage in 
memory within sub-picture processor 80. Processor 75 also 
decodes data encoded in other formats e.g. JPEG, TIF, GIF formats 

30 and in other mark-up languages e.g. SGML (Standard Generalized 
Mark-up Language) and provides the decoded data to sub-picture 
processor 80 for further processing. Processor 80, under direction 
of controller 15, formats the stored web page image pixel data for 
storage as an overlay in the pixel representative memory 

35 contained in display processor 55 for reproduction by unit 60 as a 
merged display. In addition, controller 15 incorporates a web page 
browser supporting execution of a full complement of web page 
browser functions. Thereby unit 15, together with processor 7 5 
and processor 80, provide a display via unit 60 of either a custom 
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5 web page browser or a standard browser such as Netscape 
Navigator™ through which full Internet access is available. 

Sub-picture processor 80 incorporates an On-Screen 
Display (OSD) text and graphics generator used in decoding and 
processing sub-picture data from unit 43. Processor 80 also uses 
10 its internal OSD generator in creating pixel mapped data 
representing program guide, subtitling, control and information 
menu displays including selectable menu options, and other 
ancillary items. The text and graphics produced by processor 8 0 
are generated in the form of overlay pixel map data under 

15 direction of controller 15. This overlay pixel map data is combined 
and synchronized with the decompressed pixel data from MPEG 
decoder 50 and decoded Internet protocol web page data from 
processor 75 in the pixel representative memory contained in 
display processor 55. Combined pixel map data representing a 

20 video program on sub-channel SC from unit 50 together with web 
page display data and associated sub-picture text message data 
from unit 80 is encoded as an NTSC signal by processor 55 and 
output for reproduction by unit 60 as a merged display. Unit 55, 
in another mode, also encodes the analog video signal provided via 

25 mux 35 from tuner 30 as an NTSC signal for output and 
reproduction by unit 60. 

Set-top box system 12 supports a full complement of 
multimedia functions in addition to the described exemplary web 
browsing and MPEG video processing functions. These multimedia 

30 functions include, for example, Email, Internet telephony, 
conventional telephony, fax, videophone, radio, broadcast audio, 
storage and home control functions. The decoding and 
prioritization principles detailed herein are also applied in the 
processing of data for such multimedia functions. For example, in 

35 the processing of Internet telephony data, processor 7 5 
decompresses and decodes compressed audio data encoded in 
Internet protocol format and assigned a high level e.g. real time 
processing priority by unit 43. The decompressed audio data is 
provided by processor 75 to unit 63 for audio reproduction. 

40 Further, processor 75 incorporates functions for the processing of 
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5 multimedia data in different data formats and protocols for 
presentation to a user following processing by units 80, 55, 60, 6 I 
and 63 in a manner similar to that previously described. 

Controller 15, in conjunction with modulator 85 and 
scheduler 43, initiates and implements return channel 
10 communication with an Internet or broadcast service provider on 
the coaxial cable input link via splitter/combiner 25. A message 
request for Internet web page information (or a request 
associated with another function), for example, may be initiated 
by user selection of a displayed menu option on unit 60. Controller 
15 15, in conjunction with unit 85 and scheduler 43 generates, 
prioritizes and encodes the web page request message for 
transmission to a service provider on the coaxial cable link via 
unit 25. Controller 15 also determines whether the requested 
Internet access is authorized from conditional access or smart card 

20 user entitlement information e.g. from a smart card unit (not 
shown to simplify the drawing). If the requested Internet access is 
authorized, controller 15 initiates communication with a service 
provider on the return channel. Controller 15, in conjunction with 
units 43 and 85, establishes communication with the service 

25 provider using pre-stored request access data (such as telephone 
number, IP address, URL code and conditional access data) and 
generates web page request message data. The generated request 
message data is in Internet protocol format and incorporates the 
appropriate source, destination and IP address codes, 

30 Scheduler 43 stores and buffers the web page request 

message data packets in memory and sequentially accesses the 
packets in accordance with a predetermined priority profile (map) 
associating return data having a specific characteristic and 
function with a desired priority. Thereby, unit 43 provides 

35 buffered prioritized web page request message data to modulator 
85. Modulator 85 forward error corrects, interleaves and encodes 
the request message data using QPSK (Quaternary Phase- Shift 
Keying) modulation. Unit 85 also optionally encrypts the request 
message data (under direction of controller 15) in a secure data 

40 format and transmits the encoded data with the desired priority 
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5 to a service provider via the cable link and unit 25. Unit 85 may 
alternatively code, scramble or interleave the request message (or 
other return data) or employ other protection mechanisms to 
enhance data security. Such data security is of particular 
importance in electronic transaction type messages e.g. involving 

10 credit card data. In addition, the return channel may also be used 
for functions such as a) telemetry including meter reading, b) 
video and alarm monitoring, c) home environment monitoring, d) 
home appliance monitoring, e) merchandise ordering and f) 
program conditional access and entitlement management. The 

15 method of prioritizing received and return data employed by 
scheduler 43 is described later in more detail in connection with 
Figures 6 and 7. 

As previously described, the architecture of the set- 
top box system of Figure 1 provides independent concurrent 

20 processing of broadcast data in different formats and from 
different sources (e.g. MPEG program data from a broadcast source 
and Internet protocol web page data from an Internet service 
provider). This architecture is fully scaleable and enables the 
decoding of dynamically partitionable data and bandwidth 

25 between the two downstream (e.g. MPEG and Internet) processing 
paths. As such, the architecture supports concurrent decoding of 
an MPEG broadcast of an HBO movie and accompanying Internet 
web page data, for example. In this example, the accompanying 
web page data is intermittent and the bandwidth occupied by the 

30 web page data may be dynamically re-allocated to the MPEG data 
or other supplementary data services e.g. program guide, Email 
etc. The architecture also permits the dynamic partitioning of 
bandwidth between the return channel path and the two 
downstream processing paths. 

35 Figure 2 shows exemplary characteristics of the 

downstream Internet protocol data and MPEG broadcast video 
channels. Although Figure 2 shows identical characteristics for 
both downstream channels, this is exemplary only and the 
characteristics may be different for each channel. Figure 3 shows 

40 exemplary characteristics of the upstream return communication 
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5 channel. Figure 4 lists the data traffic type and an exemplary bit 
rate allocation for services provided via a downstream channel of 
figure L Figure 5 lists the data traffic type and an exemplary bit 
rate allocation for services provided via the upstream channel of 
figure 1. The processing architecture of the set-top box system 1 2 
10 of Figure 1 is fully scaleable and is capable of adaptively 
processing data dynamically allocated between the two 
downstream channels. Set-top box system 12 is also capable of 
adaptively processing data occupying a bandwidth that is 
dynamically allocable between the downstream channels and the 
15 return channel. 

Figure 6 shows a priority schedule system for 
prioritizing processing of MPEG broadcast and Internet protocol 
data packets received from units 40 and 70 (Figure 1 ) 
respectively. The system of Figure 6 is also used for prioritizing 
20 processing of data for return communication to a service provider 
via unit 85 (Figure 1). In the system of Figure 6, input data e.g. 
MPEG, Internet protocol TCP/IP or return data is placed in a n 
input storage stack 600. Network interface 610 identifies the type 
of received data in stack 600 (e.g. MPEG, Internet protocol or 
25 return data) and formats it for identification of characteristics 
(attributes) by intelligent scheduler 620. Scheduler 620 responds 
to control and synchronization messages 615 from controller 1 5 
(Figure 1) in performing intelligent scheduling functions. 

Scheduler 620 (Figure 6) examines the formatted data 
30 from interface 610 for function, protocol and communication 
channel attributes contained in priority profile 640 stored in 
internal DRAM storage. Scheduler 620 also compares attributes in 
the received data with attributes in the priority profile and 
collates the received data packets by desired output priority 
35 based on this comparison. Scheduler 620 allocates storage in 
sequential output FIFO (First- In First-Out) unit 650 based on the 
desired output priority (e.g. critical, high, medium or low priority - 
640) and provides the collated prioritized data to allocated storage 
locations in FIFO 650 via a high speed DMA (Direct Memory 
40 Access) interface 630. Output processor 660 sequentially accesses 
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5 the prioritized data from FIFO 650 and formats it for further 
processing by units 40, 70 and 85 (Figure 1). 

Figure 7 shows a flowchart detailing a method for 
prioritizing processing of input MPEG broadcast data, Internet 
protocol data and return data suitable for use in the system , of 
10 Figure 6. In step 705 of Figure 7, following the start at step 700 
scheduler 620 (Figure 6) receives input data and in step 710 
retrieves priority profile information from memory. The priority 
profile hierarchically associates a particular desired output 
priority to input data exhibiting a particular attribute or 
15 combination of attributes. The priority profile may be transmuted 
from a service provider, entered by a user or may comprise pre- 
ssed default information or may be derived from *'™*™ tl °* 
of these sources. A service provider is able to provide different 
grades of service each offering a user different data access times 
20 at corresponding different billing rates by downloading a priority 
profile t!> a user's set-top box system. The downloaded priority 
Profile enables the service provider to control user access to 
received information. For example, by downloading (or pre- 
vailing) a priority profile, an Internet service provider may 
25 provide Internet access at a minimum data rate of 1 kbit per 
Lond at $10 per month and 5 kbits per second at $20 per month. 
AlLatively, a user may enter priority profile infonnauo. o 
configure his system to process and communicate data or 
messages in a desired order or with a desired precedence. 
,0 The priority profile information may be security 

encoded e.g. by encryption, scrambling or coding for dat. 
protection purposes in order to prevent unautho nzed ™ * £ 
high speed and premium data access levels of service. In th* case 
the priority profile information is decoded (e.g. decrypted or 
35 tscLble'd) 'by controller 15 (Figure 1) in —-J'* 
scheduler 620 (Figure 6), prior to its use. Such decryption or 
descrambling may be authorized and implemented in a , coodm -1 
access and entitlement management system in the se top .box 
svstem 12 of Figure 1 (not shown to preserve drawing clarity). It 
40 Tto be noted L the priority profile may be transmitted to any 
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5 and all nodes in a network system such as the Internet or an 
intra-net, LAN or WAN etc. for assuring quality of service (QOS). 
The nodes may include network devices such as servers 
(distribution hubs), gateways, terminals, routers and switches. The 
priority profile may also be distributed and used in conjunction 

10 with communication protocols incorporating data priority 
indicators for reserving network resources to ensure quality of 
service throughout a network communication path or merely for 
sections of a path. Such communication protocols include, for 
example, Resource Reservation Protocol (RSVP) Internet draft 

15 June 14 1997; Real-time Transport Protocol (RTP) Request for 
Comment document RFC 1889, February 1, 1996, both documents 
being available on the Internet. The priority profile information 
may also be used in systems operating in accordance with 
standards defining system elements for multimedia networking 

20 and communication such as H.323 of November 1996 and H.324 
developed by the International Telecommunication Union (ITU). 

In step 715 of Figure 7, scheduler 620 identifies 
attributes in data received in step 705. The attributes identified 
include (i) protocol characteristics, (ii) function type characteristics 

25 and (iii) communication channel characteristics. 

The protocol characteristics include, for example, (a) a 
data source identifier, (b) a data destination identifier, (c) a data 
type identifier, (d) a data priority indicator, (e) a data error 
indicator, (f) an entitlement indicator, (g) an Internet protocol 

30 indicator, (h) an MPEG compatible indicator, and (i) a packet 
identifier. 

The function type characteristics identify, for example, 
functions including a) Email, b) Internet web page browsing, c) 
Internet telephony, d) conventional telephony, e) fax, f) broadcast 
35 video processing, g) videophone processing, h) broadcast radio 
processing, i) broadcast audio processing and j) home control 
functions such as alarm, telemetry, appliance and environment 
control and monitoring. 

The communication channel characteristics identify the 
40 type of physical communication link e.g, telephone line, terrestrial, 
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5 cable or satellite link, fiber optic link, Wide Area Network (WAN), 
Local Area Network (LAN), Internet, or intra-net. The 
communication channel characteristics also identify different 
channels of the same type of communication link e.g. different 
telephone lines. 

10 In step 720 of Figure 7, scheduler 620 compares 

attributes identified in step 715 with attributes in the priority 
profile and in step 725 collates the packetized input data by 
desired output priority based on this comparison. The use of a 
priority profile in this manner provides a flexible means of 
1 5 structuring the priority of a wide variety of data derived from a 
plurality of different sources. Data may be advantageously 
prioritized by any combination of communication link, protocol or 
function characteristics. Thereby data of a particular function, or 
data communicated on a particular link, may be prioritized by 
20 source or destination or type. Email messages, for example, may 
be prioritized according to source identifier i.e. Email from certain 
sources may be given higher priority. Similarly, return messages 
to specific destinations (identified by destination identifier) may 
be allocated and coded with a higher priority. Further, scheduler 
25 620 interprets dedicated priority indicators e.g. an Internet 
protocol data type (precedence) indicator in the input data and 
allocates this data the appropriate priority. Similarly, hierarchical 
processing priority may also be allocated using the priority profile 
based on entitlement indicators, Internet protocol indicator, MPEG 
30 compatible indicator e.g. packet identifiers. 

In step 730, scheduler 620 allocates storage in a 
sequential output FIFO (First-In First-Out unit 650 of Figure 6) 
based on the desired output priority and provides the collated 
prioritized data to the allocated storage locations in FIFO 650 via a 
35 high speed DMA (Direct Memory Access) interface 630. The 
collated prioritized packet data is output from FIFO 650 with the 
desired output priority in step 733 (Figure 7). In step 735, the 
collated prioritized output data is processed for reproduction and 
presentation to a user or for return transmission to a service 
40 provider. Such processing may involve encoding and encrypting 
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5 the data for secure return communication, for example, and 
synchronizing the data with other set-top box processes. The 
process ends at step 740. 

Figure 8 shows a server distribution hub 102 for 
distributing broadcast data and providing multimedia services 

10 from one or more service providers 109 to the set-top box system 
12 ( Figure 1 and 8) and for processing upstream data from unit 
12, according to the invention. QAM modulated broadcast data 
such as MPEG compatible video data or analog representative 
video data from one or more service providers 109 (Figure 8) is 

15 provided via optical fiber link 145 and channel 135 to mux 125. 
Unit 125 provides a multiplexed output from sources including the 
received broadcast data from channel 135, local hub generated 
data 137, and from QAM modulated data from cable modem 
termination 150 (via up converter 134). The multiplexed output 

20 from mux 125 is output to optical fiber communication interface 
120, Unit 120 communicates with set-top box system 12 of Figure 
1 by transmitting downstream QAM data and receiving upstream 
QPSK (or QAM) data on high frequency channel 110 via optical 
fiber link 115, coax 105 and electrical to optical converter 107. 

25 Upstream data from set box 12 is received by unit 120 

via channel 110 and routed via splitter 155 and down converter 
160 to cable modem termination system 150. System 150 
demodulates the QPSK modulated upstream data from converter 
160 and provides the demodulated upstream data to service 

30 provider 109 via network interface 154, optional hub switch 140 
and optical fiber link 145. Alternatively, optional hub switch 140 
may provide the demodulated upstream data to an optional WAN 
device 130. Unit 154 of system 150 also receives downstream 
data from service provider 109 or WAN device 130 via switch 

35 140. Unit 154 formats and processes the downstream data from 
switch 140 and provides it to unit 152 for QAM modulation and 
subsequent up conversion by converter 134. The up-converted 
data from converter 134 is transmitted to set-top box system 1 2 
via mux 125 as previously described. 
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5 Figure 9 lists and describes the exemplary interfaces 

1-10 identified in the server system of Figure 8, according to the 
invention. 

The architectures of Figures 1, 6 and 8 are not 
exclusive. Other architectures may be derived in accordance with 
10 the principles of the invention to accomplish the same objectives. 
Further, the functions of the elements of system 12 of Figure 1 
and the process steps of Figure 7 may be implemented in whole or 
in part within the programmed instructions of a microprocessor. 
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5 

CLAIMS 

1. A multimedia decoder (10,20) apparatus supporting 
a plurality of functions and communicating on at least one 
10 physical communication link, comprising: 

a first processor (75) for decoding data packed zed 
according to an Internet protocol data format to provide a first 
decoded output; 

a second processor (15,85) for encoding data according 
15 to said Internet protocol data format for return communication to 
a broadcast source; and 

means for prioritizing (15,43) received data for 
processing by said first processor and for prioritizing data for 
encoding for return communication by said second processor, said 
20 received data and said data for encoding being allocated a desired 
hierarchical data output priority based on at least one of, 

a) a function associated with data to be 

prioritized, and 

b) a protocol characteristic of data to be 

25 prioritized. 

2. Apparatus according to claim 1, wherein 

said function comprises one or more of a) Email, b) 
Internet web page browsing, c) Internet telephony, d) telephony, 
30 e) fax, f) broadcast video, g) videophone, h) broadcast radio, i) 
broadcast audio and j) home control. 

3, Apparatus according to claim 1, wherein 

said desired hierarchical data output priority is 
35 allocated based on the type of physical communication link used. 
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5 4. Apparatus according to claim 1, wherein 

said protocol characteristic comprises at least one of a) 
a data source identifier, b) a data destination identifier, and c) a 
data type identifier. 

10 

5. Apparatus according to claim 1, wherein 

said second processor encodes data in a secure data 

format. 

15 6. Apparatus according to claim 5, wherein 

said secure data format is one or more of a) an 
encrypted format, b) a coded format, c) a scrambled format, and 
d) an interleaved format. 

20 7. Apparatus according to claim 1, including 

a third processor (50) for decoding broadcast video 
data packetized according to an MPEG compatible data format to 
provide a decoded video output. 

25 8. Apparatus according to claim 7, including 

a display processor (55,80) for forming a display 
image from said decoded video output. 

9. Apparatus according to claim 1, including 
30 means for synchronizing (15,55) said return 

communication with said decoding. 
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5 10. A multimedia decoder apparatus supporting a 

plurality of functions and communicating on at least one physical 
communication link, comprising: 

a first processor (75) for decoding data packetized 
according to an Internet protocol data format to provide a first 
10 decoded output; 

a second processor (15,85) for encoding data according 
to said Internet protocol data format for return communication to 
a broadcast source; 

a third processor (50) for decoding broadcast video 
15 data packetized according to an MPEG compatible data format to 
provide a decoded video output; 

means for prioritizing (15,43) data for processing by 
said first, second and third processors in accordance with a 
protocol characteristic of said data for processing; and 
20 a display processor (55,80) for forming a display 

image from said first decoded output and said decoded video 
output. 

11. Apparatus according to claim 10, wherein 

25 said protocol characteristic comprises at least one of a) 

a data source identifier, b) a data destination identifier, and c) a 
data type identifier. 

12. Apparatus according to claim 10, wherein 

30 said means for prioritizing identifies said protocol 

characteristic by examining said data for processing for one or 
more characteristics contained in a data priority processing map 
associating individual characteristics with particular desired 
processing priorities. 



35 



13. Apparatus according to claim 12, wherein 

said priority processing map associates individual 

physical communication channels with particular desired 

processing priorities. 



40 
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5 14. Apparatus according to claim 12, wherein 

said priority processing map associates a function with 
particular desired processing priorities, and said function 
comprises one or more of a) Email, b) Internet web page browsing, 
c) Internet telephony, d) telephony, e) fax, f) broadcast video, g) 
10 videophone, h) broadcast radio, i) broadcast audio and j) home 
control. 

15. Apparatus according to claim 12, wherein 

said priority processing map is derived from at least 
15 one of, a) data entered by a user via a data entry device, b) data 
transmitted in Internet protocol on a physical communication 
channel, c) data transmitted in MPEG compatible format on a 
physical communication channel, d) default information stored i n 
said multimedia decoder by a manufacturer. 

20 

16. A method for processing multimedia data to 
support a plurality of functions, comprising the steps of: 

allocating a hierarchical data output priority to 
Internet protocol received data and to data for return 
25 communication, said desired hierarchical data output priority 
being allocated based on at least one of, 

a) a function associated with data to be 
prioritized, and 

b) a protocol characteristic of data to be 
30 prioritized; 

prioritizing said received data and said data for return 
communication using said allocated hierarchical data output 
priority; 

decoding said prioritized received data according to 
35 said allocated hierarchical data output priority to provide a first 
decoded output; and 

encoding said prioritized data for return 
communication according to said allocated hierarchical data output 
priority. 

40 
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5 17. A method according to claim 16, wherein 

said function comprises one or more of a) Email, b) 
Internet web page browsing, c) Internet telephony, d) telephony, 
e) fax, f) broadcast video, g) videophone, h) broadcast radio, i) 
broadcast audio and j) home control. 

10 

18. A method according to claim 16, wherein 
said hierarchical data output priority is allocated based 
on the particular type of physical communication channel used. 

15 19. A method according to claim 18, wherein 

said type of physical communication channel 
comprises one of a) telephone lines, b) co-axial cable, c) terrestrial 
broadcast, d) satellite broadcast, and e) optical fiber. 

20 20. A method according to claim 16, wherein 

said protocol characteristic comprises at least one of a) 
a data source identifier, b) a data destination identifier, and c) a 
data type identifier. 
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FIG. 2 
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FIG. 3 
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FIGURE 7 
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INTERFACE # 



PHYSICAL FORMAT 



DESCRIPTION 



CABLE MOOEM TERMINATION 
SYSTEM-NETWORK SIDE 
INTERFACE AND CABLE MODEM 
TERMINATION SYSTEM SECURITY 
MANAGEMENT INTERFACE 

OR EXAMPLE, 

SONET ATM OVER OC-3, FAST 
ETHERNET OR ANOTHER 
NTERFACE 



THIS IP BASED PHYSICAL INTERFACE 
ERVES SEVERAL LOGICAL FUNCTIONS: 

ACCESS TO THE SECURITY AND ACCESS 
CONTROLLER SERVER. CABLE MODEM 
TERMINATION SYSTEM SECURITY MANAGEMENT 
INTERFACE THIS COMMUNICATION UNK IS 
IMPLEMENTED USING A SECURE NETWORK ACCESS 
PROTOCOL SUCH AS REMOTE AUTHENTICATION 
DIAL4N-USER SERVICEIRADIUS). THE SECURITY 
SERVER IS IMPLEMENTED ON AN OPEN COMPUTING 
PLATFORM. AND CAN RESIDE IN THE CENTRAL HEAD 
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110 
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FIG. 9 
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